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CROSS REFERENCE TO RELATED APPLICATIONS 

This Application claims the priority of United States provisional patent application 
No. 60/1 56,605 filed September 29, 1999. 

BACKGROUND OF THE INVENTION 

Technical Field 

This invention relates to the field of distributed messaging and more particularly 
to a distributed messaging system for transmitting topical data messages from data 
publishers to data consumers . 

Description of the Related Art 

Conventional distributed computing can require that multiple computer 
application processes share data over a computer communications network. 
Specifically, distributed computer applications can require that processes running in one 
computing device share data with one or more processes running in other computing 
devices communicatively connected to one another in a computer communications 
network. Communications between distributed applications can require significant 
coordination and control in order to ensure that data which is received is correct and 
accurate. Disruption in communications can be catastrophic if the distributed 
applications cannot adequately detect a break in communications and respond 
accordingly. 

In a typical distributed system there may be hundreds of computers running 
many application programs. In consequence, sharing data entails not only establishing 
a means of communication between the application programs across a network but also 
providing the capability to recover from failures. These failures may be due to physical 
network problems, software problems, or other error conditions. Recovering from a 
fault or problem is a critical issue in the arena of distributed computing. 

The problem of communications disruption in distributed computing has been 
addressed in U.S. Patent 5,887,127 for Self-Healin a Network Initiating Fault 
Restoration Activities from Nodes at Successively Delaved Instants issued on March 
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23, 1999 to Saito et al., and in U.S. Patent 5,390,326 for Local Area N etwork with Fault 
Detection and Recovery issued on February 14, 1995 to Shah. Both Shah and Saito 
illustrate how previous work in providing resiliency in communications between 
processes has focused on the underlying communications network. Specifically, Shah 
5 teaches the generation and transmission of a heartbeat signal from various nodes in a 
network in order to monitor the network for the occurrence of a fault. In contrast, Saito 
is directed towards coordinating fault recovery among several nodes in a network. In 
particular, Saito provides for time-staggered fault recovery among the various nodes in 
a network. Additionally, U.S. Patent 5,319,774 for Rficoverv Facilitv for Incomplete 
10 Sync Points for Distributed Application issued on June 7, 1994 to Ainsworth et al. 
f 3 focuses on the re-synchronization of database files across disparate operating 
li environments subsequent to the occurrence of a communications fault. 
'J Still, neither Shah, Saito, nor Ainsworth teach a distributed messaging system 

£3 capable of recovering and re-synchronizing interprocess communications between data 
15 Fii publishers and data consumers in a distributed messaging system. Yet, distributed 
:_ applications are increasingly utilizing asynchronous communications, typically in the 
ij form of messages between processes, as the means for sharing data and providing 
'X notification of events between application processes. In the event of a loss of 
53 communications, either through network failure or the failure of one of the 
20 communicating processes, messages may be lost which can adversely affect the 

correct operation of the distributed system. Problems arise when attempting to restore 
communications between two applications in a distributed system because the 
processes involved in the communications must re-synchronize the message flow 
between them. This requires significant information to be maintained by each process 
25 involved in sending or receiving messages. 
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SiJMMARY OF THE INVENTION 

A distributed messaging system for transmitting topical data messages from data 
publishers to data consumers in accordance with the inventive arrangements satisfies 
the long-felt need of the prior art by defining a method for re-synchronization of 
message traffic between multiple processes across multiple computers. A distributed 
messaging system for transmitting topical data messages from data publishers to data 
consumers can include a message topic server; a plurality of message routers; and, a 
plurality of message adapters. Each data publisher can be communicatively linked to a 
message adapter, each data consumer can be communicatively linked to a message 
adapter, each message adapter can be communicatively linked to a message router, 
3 and each message router can be communicatively linked to the message topic server. 
i The message topic server can have a list of message topics to which data 

consumers can subscribe and a list of data publishers able to publish data messages 
3 consonant with the message topics. The message routers can subscribe to selected 
3 message topics in the list in the message topic server on behalf of requesting data 
= consumers. The message routers also can register message topics with the message 
3 topic server on behalf of requesting data publishers which publish data messages 
5 consonant with the registered message topics. Moreover, the message routers can 
^ transmit and receive data messages to and from respective data consumers and data 
publishers according to the subscriptions. Finally, the transmitted and received data 
messages can be transmitted and received to and from the respective data consumers 
and data publishers through message adapters which are communicatively linked to the 
respective data consumers and data producers. 

The present invention can include a distributed messaging method for publishing 
topical data messages in a communications network comprising. The method of the 
invention can include the steps of receiving in a first message router from a data 
consumer a request to subscribe to a message topic; responsive to receiving the 
subscription request, retrieving from a message topic server a location of a second 
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message router communicatively linked to a data publisher able to provide data 
messages consonant with the requested message topic; establishing an interprocess 
communications connection between the first and second message routers; and, 
transmitting data messages from the data publisher over the established interprocess 
communications link to the data consumer. 

Notably, the step of establishing an interprocess communications connection can 
include establishing a multicast data communications link between the first and second 
message routers. Accordingly, the transmitting step can include multicasting data 
messages from the data publisher over the multicast data communications link to the 
data consumer. 

The method of the invention also can include detecting a communications 
interruption. In one aspect of the invention, the step of detecting can include detecting 
a communications break between the data publisher and the second router. In another 
aspect of the invention, the step of detecting can include detecting a communications 
break between the first and second routers. Finally, in yet another aspect of the 
invention, the detecting step can include detecting the data publisher terminating 
publication of the requested message topic. 

Responsive to detecting the interruption, the method can include the steps of 
terminating the subscription, retrieving from the message topic server a location of a 
message router communicatively linked to a data publisher able to resume the 
providing of the data messages consonant with the requested message topic, 
establishing an interprocess communications connection between the first message 
router and the message router communicatively linked to a data publisher able to 
resume the providing of the data messages, and resuming the transmission of the data 
messages from the data publisher over the established interprocess communications 
connection between the first message router and the message router communicatively 
linked to a data publisher able to resume the providing of the data messages. Notably, 
the step of establishing an interprocess communications connection between the first 
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message router and the message router communicatively linked to a data publisher 
able to resume the providing of the data messages can include re-establishing an 
interprocess communications connection between the first and second message 
routers. 
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BRIEF DESCRIPTION OF THE DRAWINGS 



There are presently shown in the drawings embodiments which are presently 
preferred, it being understood, however, that the invention is not limited to the precise 
arrangements and instrumentalities shown. 

Figure 1 is a schematic diagram of three network messaging components which 
can form a distributed messaging system for transmitting topical messages from data 
publishers to data consumers. 

Figure 2 is an object relationship diagram showing message-oriented 
middleware topic registration and subscription typical during nominal operation of the 
system of the invention. 

Figure 3 is an object relationship diagram showing IP multicast topic registration 
and subscription typical during nominal operation of the system of the invention. 

Figure 4 is an object relationship diagram showing a process for recovery and re- 
synchronization following a fault in a message adapter. 

Figure 5 is an object relationship diagram showing a process for detection, 
recovery and re-synchronization following a fault in a message router 

Figure 6 is an object relationship diagram showing a process for detection, 
recovery and re-synchronization following a termination of publication by a data 
publisher. 

Figure 7 is an UML object model depicting components and relationships of a 
client application, message adapter and message router. 

Figure 8 is a state transition diagram illustrating the operational states of a 
message router. 

Figure 9 is a state transition diagram illustrating error recovery paths for the 
message router. 
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DETAILED DESCRIPTION OF THE INVENTION 

The present invention is a distributed messaging system for transmitting topical 
messages from data publishers to data consumers. By virtue of the architecture of the 
present invention, the system and method of the present invention can re-synchronize 
interprocess communications between data publishers and data consumers in a 
distributed messaging system. More particularly, as shown in Figure 1 , the system of 
the invention can include a message topic server 125; a plurality of message routers 
115; and, a plurality of message adapters 110, distributed across several computing 
devices 100 in a computer communications network 120. 

The message adapters 1 10 can be communicatively linked to an application 105. 
The communications link which communicatively links applications 105 to message 
adapters 110 can be any suitable communicative link including, but not limited reliable 
point-to-point communications, for example TCP/IP. Alternatively, the message adapter 
110 can be included as an embedded component of the application 110, for example as 
an additional module. 

In accordance with the present invention, an application 105 can be one of a 
data consumer or a data publisher each executing in a computing device 100. More 
particularly, data consumers consume and process data messages published by data 
publishers. Conversely, data publishers can publish data messages for consumption by 
data consumers. For ease of illustration, Figure 1 depicts three applications 105 any of 
which can be data consumers or data publishers. 

Data publishers can be communicatively linked to corresponding message 
adapters 110 executing in the same computing device 100. Similarly, data consumers 
can be communicatively linked to message adapters 110 executing in the same 
computing device 100. Notably, each message adapter 110 can be communicatively 
linked to a message router 115, typically executing in the same computing device 100. 
Moreover, each message router 115 can be communicatively linked to a message topic 
server 125, typically executing in another computing device 100. 
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Notably, in all cases where one component of the present invention is 
comnnunicatively linked to another, any suitable communications link can suffice 
including a reliable TCP/IP connection or an unreliable UDP/IP connection. Moreover, 
the invention is not limited to the circumstance where each application 105, 
corresponding message adapter 110 and message router 115 reside in the same 
computing device. Rather, in a purely distributed system, each of the application 105, 
corresponding message adapter 100 and message router 1 15 can reside and execute 
in different computing devices. Conversely, the message topic server 125 is not limited 
to executing in a computing device separate from those computing devices in which the 
message routers 115 also reside and execute. Rather, the message topic server 125 
can reside in the same computing devices as those of the message routers 115 and 
message adapters 110. 

Finally, the computing devices 100 can be any suitable computing apparatus 
which can generally include a central processing unit (CPU), memory and fixed storage. 
More particularly, the computing devices 100 can include a fixed storage for storing 
computer instructions and data such as applications 105, message adapters 110, 
message routers 1 15 and message topic servers 125. The computing devices 100 also 
can include memory in which the instructions and data can be loaded at run-time. 
Finally, the computing devices 100 can include a CPU which can include an instruction 
set for performing the instructions and processing the data. Optionally, the computing 
devices 100 can include input ports, such as a serial communications port, wireless port 
or a port, and output ports, such as a serial communications port, wireless port or a 
video port. Examples of the computing devices 100 can include conventional 
computers, embedded systems, and handheld devices such as personal digital 
assistants and intelligent cellular phones. 

Returning now to Figure 1 . the message topic server 125 can have a list of 
message topics to which data consumers can subscribe and a list of data publishers 
able to publish data messages consonant with the message topics. Message topics 
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can be any suitable categorization of data messages and need not follow any particular 
format. For example, suitable message topics can include "Battery Level", "Printer #2", 
"Outside Temperature", "Current Stock Indices", etc. Data publishers can register 
message topics with the message topic server 125. In consequence, data consumers 
can subscribe to those message topics registered by the data publishers. 

By registering a message topic, a data publisher can provide data messages 
consonant with the message topic to those data consumers who choose to subscribe to 
the registered message topic. Thus, for example, a data publisher who registers the 
message topic "Printer #2" can publish data messages to those data consumers who 
have subscribed to the message topic "Printer #2". Generally, those data messages 
published by the registrar of a message topics are consonant with the message topic. 
Thus, the data publisher of the message topic "Printer #2" can publish data messages 
relating to the state of Printer #2, for instance a "paper out" message or a "print job 
complete" message. Of course, just as data publishers can register message topics, 
data publishers also can unregister message topics when the data publisher no longer 
will publish data messages consonant with the unregistered message topic. 

The message topic sen/er 125 not only can maintain a master list of all message 
topics currently available for subscription, but also the message topic server 125 can 
maintain a master list of all message topics for which data consumers have requested a 
subscription, but have not yet been registered by a data publisher. Accordingly, when a 
message topic is registered which matches a message topic previously requested by a 
data consumer, the data consumer can be notified of the message topic registration. 
Finally, the message topic server 125 can maintain a state table for tracking those 
message routers 115 through which data messages associated with registered 
message topics are transmitted to and received from respective data consumers and 
data producers. 

The message adapter 110 primarily can be used to transmit and receive data 
messages on behalf of a host application 105. More particulariy, the message adapter 
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110 can be an interface to the distributed messaging system of the present invention. 
Applications 105 which participate in the distributed messaging system need only 
interact with the interface provided by the message adapters 110. In consequence, 
applications 105 need not be modified each time the architecture of the distributed 
messaging system changes. 

In operation, where the host application 105 is a data consumer, the message 
adapter 110 can receive data messages from the network 120 and provide the same to 
the data consumer. Conversely, where the host application 105 is a data publisher, the 
message adapter 110 can receive data messages from the data publisher and transmit 
the same over the network 120. Additionally, the message adapter 110 can maintain 
state information regarding the host application 105. For example, where the host 
application 105 is a data consumer, the message adapter 110 can track the message 
topics to which the data consumer has subscribed. Similarly, where the host 
application 105 is a data publisher, the message adapter 110 can track the message 
topics which the data producer has registered with the message topic server 120. 

The message router 1 15 is a service application which can execute in a 
computing device 100 which also contains various applications 105 communicatively 
linked to corresponding message adapters 110. The message router 115 can service 
application requests to transmit and receive data messages. In addition, the message 
router 1 15 can service application requests to register and unregister message topics. 
Finally, the message router 115 can service application requests to subscribe to and 
unsubscribe from selected message topics. 

Notably, the message router 1 1 5 can track those message topics for which 
communicatively linked data consumers have subscriptions. Likewise, the message 
router 1 15 can track those message topics which communicatively linked data 
publishers have registered in the message topic server 125. Finally, the message 
router 115 can maintain a state table of interprocess communications links to other 
message routers 1 15 in other computing devices 100. Significantly, by maintaining 
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both a table of links to corresponding applications 105 and a state table of interprocess 
communications links to other message routers 115 in other computing devices 100, 
the message routers 1 1 5 can track the state of existing communications links and can 
detect faults in those communications links. Responsive to detecting a fault, the 
message routers 115 can attempt to reestablish any broken communications links with 
corresponding applications 105 and other message routers 1 15. 

Figure 2 is an operational flow diagram illustrating a process of distributing data 
messages in the distributed messaging system of the present invention during nominal 
conditions. For purposes of illustrating one aspect of the present invention, the 
distributed messaging system shown in Figure 2 includes only a message adapter 21 OA 
associated with a single data publisher, and a message adapter 21 OB associated with a 
single data consumer. One skilled in the art will recognize, however, that the invention 
is not so limited to the precise arrangement shown in Figure 2. Rather, it is an 
advantage of the present invention that multiple message adapters associated with a 
multiplicity of data publishers and data consumers can be integrated into the 
architecture of the present invention. 

As shown in Figure 2, during nominal operating conditions, initially a first 
message adapter 21 OA can register a message topic with the message topic server 
225 by transmitting a registerTopic message to the message router 21 5A. Responsive 
to receiving the registerTopic message from the message adapter 21 OA, the message 
router 21 5A can transmit a registerTopic message to the message topic server 225, In 
consequence, the message topic server 225 can add the message topic to a list of 
message topics available for subscription by data consumers. Additionally, the 
message topic server 225 can associate the message router 21 5A with the message 
topic and can add the message router 21 5A to a table of message routers with whom 
the message topic server 225 presently maintains a communications link. 

Significantly, the message adapter 21 OA need not and, in fact, does not have an 
awareness of the message topic server 225. Rather, the message adapter 21 OA only 

QBWPBM 65853.1 1 1 



6572-27 

communicates with its associated message router 21 5A. As a result, the message 
adapter 21 OA need not respond to an operational failure in the message topic server 
225. Rather, only the message adapter's 21 OA associated message router 21 5A can 
respond to a fault in communications with the message topic server 225, 

During nominal operations, data consumers can subscribe to message topics 
which have been published by data publishers. Specifically, as shown in Figure 2, at 
the behest of an associated data consumer, a message adapter 21 OB can transmit to 
an associated message router 21 5B a subscribeTopic request for a subscription to a 
particular message topic. The message router 2158 can receive the request and, in 
response, can transmit to the message topic server 225 a subscribeTopic request. 

In consequence, the message topic server 225 can add the message router 
21 5B to a list of message routers who have subscribed to the particular message topic. 
Additionally, the message topic server 225 can add the message router 21 5B to a table 
of message routers with whom the message topic server 225 presently maintains a 
communications link. Finally, the message topic server 225 can respond to the 
subscribeTopic request by transmitting to the message router 215B a currentPublishers 
message containing a host identification of a message router from which the requesting 
data consumer can receive data messages consonant with the requested message 
topic. The message topic server 225 can retrieve the host identification number from 
the list of message routers who have registered message topics in the message topic 
server 225. Specifically, the message topic server 225 can search the list for the 
requested topic and can identify therein the host identification of a message router 
associated with the requested topic. In the example shown in Figure 2, the host 
identification number provides the message router 2158 with a reference to the 
message router 21 5A. 

Like the message adapter 21 OA, the message adapter 21 OB need not and, in 
fact, does not have an awareness of the message topic server 225. Rather, the 
message adapter 21 OB only communicates with its associated message router 2158. 
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As a result, the message adapter 21 OB need not respond to an operational failure in the 
nriessage topic server 225. Rather, only the message adapter's 21 OB associated 
message router 21 5B can respond to a fault in communications with the message topic 
server 225. 

Notably, upon receiving the host identification number of the message router 
215A, the message router 215 can establish an interprocess communications link with 
the message router 215. Subsequently, the message router 21 5B can transmit a 
requestTopic message identifying the subscribed message topic to the message router 
21 5A. The message router 21 5A can receive the requestTopic message and can 
determine which of its associated message adapters has registered on behalf of a data 
publisher the requested message topic in the message topic server 225. Subsequently, 
the message router 21 5A can transmit data messages consonant with the requested 
message topic over the interprocess communications link to the message router 21 5B. 
The message router 21 5B, in turn, can forward the data messages received from the 
message router 21 5A to the originally subscribing data consumer through the message 
adaptor 21 OB. 

As shown in Figure 2 and subsequent figures, the various messages transmitted 
between the network components are numbered so as to indicate some order as to the 
transmission of the messages. Notwithstanding, one skilled in the art will recognize that 
the numbering of the messages does not limit the implementation of each process to 
the precise ordering shown. Rather, in many cases, messages can be transmitted in a 
different order without affecting the result of the process. Moreover, as in the case of 
typical distributed systems, messages can be transmitted concurrently with the 
transmission of other messages. For example, the message adapter 21 OB just as well 
could subscribe to a topic prior concurrently with the message adapter 21 OA registering 
the same topic. 

Figure 3 is an operational flow diagram illustrating a process of distributing data 
messages in the distributed messaging system of the present invention during nominal 
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conditions as in Figure 2. However, as will be apparent to one skilled in the art, the 
distributed nnessaging system of Figure 3 transmits data messages from data 
publishers to data consumers over IP multicast links. Specifically, data publishers can 
multicast data messages to those data consumer subscribers who have established a 
connection on an IP multicast port which carries the multicast data. 

As is well known in the art, IP multicasting involves the transmission of data to 
distributed servers on a Multicast Backbone (MBone). For large amounts of data, IP 
Multicast can be more efficient than conventional point-to-point Internet transmissions 
because a multicast server can narrowcast a message to many recipients 
simultaneously. Unlike traditional Internet traffic which can require separate 
connections for each source-destination pair, IP Multicasting allows many recipients to 
share the same data source. In consequence, merely one set of data packets need be 
transmitted for all the destinations. IP Multicasting has been defined as an international 
standard by the Internet Engineering Task Force in S.E. Deering, Host extensions for IP 
multicasting (RFC 1112 Aug-01-1989). 

As shown in Figure 3, during nominal operating conditions, initially a first 
message adapter 31 OA can register a message topic with the message topic server 
325 by transmitting a registerTopic message to the message router 31 5A specifying 
that the data messages should be multicast to the various data consumers. 
Responsive to receiving the registerTopic message from the message adapter 31 OA, 
the message router 31 5A can transmit a registerTopic message to the message topic 
sen/er 325 specifying both the message topic name and the multicast channel address 
upon which data messages relating to the message topic will be transmitted. 

In consequence, the message topic server 325 can add the message topic to a 
list of message topics available for subscription by data consumers. Additionally, the 
message topic server 325 can associate the message router 31 5A with the message 
topic and can add the message router 31 5A to a table of message routers with whom 
the message topic server 325 presently maintains a communications link. Finally, the 
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message topic server 325 can return a status message to the message router 31 5A 
confirming the registration of the message topic and the current transmission status of 
the specified multicast channel. The message router 31 5A, in turn, can forward a 
status message to the message adaptor confirming reporting the current transmission 
status of the specified multicast channel.. 

During nominal operations, data consumers can subscribe to multicast message 
topics which have been published by data publishers. Specifically, as shown in Figure 
3, at the behest of an associated data consumer, a message adapter 31 OB can transmit 
to an associated message router 31 5B a subscribeTopic request for a subscription to a 
particular message topic. The message router 31 5B can receive the request and, in 
response, can transmit to the message topic server 325 a subscribeTopic request. In 
consequence, the message topic server 325 can add the message router 315B to a list 
of message routers who have subscribed to the particular message topic. Additionally, 
the message topic server 325 can add the message router 31 5B to a table of message 
routers with whom the message topic server 325 presently maintains a communications 
link. 

The message topic server 325 can respond to the subscribeTopic request by 
transmitting to the message router 31 5B a currentPublishers message containing both 
an address of the multicast channel and the current status of data message 
transmission across the multicast channel. Concurrently, the message topic server 325 
can notify the message router 31 5A that a new data consumer has subscribed to the 
message topic on the multicast data channel. In turn, the message router 31 5A can 
confirm the subscriber list of those message routers communicatively linked to the 
multicast channel specific to the subscribed message topic. Upon receiving the 
address of the multicast data channel, the message router 31 5B can establish an IP 
multicast communications link with the message router 31 5A. Subsequently, the 
message router 31 58 can extract from the multicast channel those data messages 
pertinent to the subscribed message topic. 
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Notably, the distributed messaging system of the present invention can utilize a 
shared state memory which can store both message traffic and network configuration 
data. More particularly, the three network components (message adaptor, message 
router and message topic server) can form the shared state memory which can contain 
5 data regarding both network message traffic and network configuration, in 

consequence, the distributed nature of the message traffic and network configuration 
data can enable the reconstruction and re-synchronization of interprocess 
communications should the distributed messaging system experience a 
communications fault with any combination of the three network components. 
10 Significantly, as is apparent in Figures 2 and 3, each system component 

n maintains an awareness only of the components to which it is directly communicatively 
linked. In consequence, client applications are oblivious to the network configuration, 
message flow, and other client applications with which each may be communicating, 
f 3 As a result, the sphere of influence remains encapsulated in the event of a process 
15 failure. For example, If a client process fails, the failure does not affect the state of the 
! client application with which the client process had been communicating because the 
3 client application had no direct communications with the failed client process, 
i S Similarly, if a message router fails, the failure can affect only those processes to which 
E the message router had been connected. 
20 " Specifically, only the client applications the message router had been sen/icing, 

other message routers to which the message router had been connected, and the 
message topic server can be affected by the message router failure. Despite the 
failure, however, remaining message routers, message topic servers, and client 
applications to which the failed message router is not connected are not effected. 
25 Moreover, those remaining message routers, message topic servers and client 
applications can recover from the network failure automatically. 

Figures 4-6 are operational flow diagrams Illustrating several methods for 
recovering and re-synchronizing Interprocess communications following an Interprocess 
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communications fault in the distributed messaging system of the present invention. 
Significantly, each recovery and re-synchronization process shown in Figures 4-6 can 
be facilitated by the distributed architecture of the present invention. More particularly, 
the implementation of the three distributed network components-message adapter, 
message router and message topic server-permits the foregoing recovery and re- 
synchronization processes which otherwise could not occur in the manner described 
herein. 

Figure 4 illustrates an exemplary recovery process triggered by the detection of a 
communications fault in the publication process. As shown in the figure, initially a 
communications fault in the message adaptor 41 OA is detected by the message router 
41 5A. In response, the message router 41 5A both unregisters the message topic 
published by the data producer associated with the message adaptor 410A and notifies 
the communicatively linked message router 41 5B that the transmission of data 
messages relating to the subscribed message topic have been interrupted. 

The message topic server 425, upon receiving an unregisterTopic message, can 
remove the message topic from the list of message topics available for subscription by 
data consumers. Upon receiving the terminateTopic message from the message router 
415A, the message router 41 5B can attempt to re-subscribe to the discontinued 
message topic by transmitting a subscribeTopic message to the message topic server 
425. Upon receiving the subscribeTopic message from the message router 41 5B, the 
message topic server 425 again can retrieve a host identification number of a suitable 
message router from the list of message routers who have registered message topics in 
the message topic server 425. Specifically, the message topic server 425 can search 
the list for the requested topic and can identify therein the host identification of a 
message router associated with the requested topic. In the example shown in Figure 4, 
the message topic host 425 is unable to find a suitable message router to service the 
requested subscription. Accordingly, the message router 41 58 can notify the message 
adapter 41 OB that the message topic is no longer available. 
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Figure 5 illustrates an exemplary recovery process triggered by the detection of a 
communications fault in a message router. As shown in the figure, initially each of the 
message adapter 51 OA and the message topic server 525 can detect a 
communications fault in the message router 51 5A. Additionally, the message router 
51 5B communicatively linked to the message router 51 5A can detect the 
communications fault. Upon detecting the communications fault, the message router 
51 5B also can both notify the message topic server 525 and the subscribing message 
adapter 51 OB of the loss of service. 

Responsive to receiving notification of a communications fault in the message 
router 51 5A, the message topic server 525 can remove the message router 51 5A from 
a table of message routers with whom the message topic server 525 presently 
maintains a communications link. Moreover, the message topic server 525 can remove 
a list of topics which can associate the message router 51 5A as an available 
subscription source. 

Responsive to detecting a communications fault in the message router 51 5A, the 
message adapter 510A can attempt to re-register the message topic with the message 
router 51 5A by transmitting a registerTopic message. Assuming that the message 
router 51 5A has recovered from whatever failure had caused the communications fault, 
the message router 51 5A can receive the registerTopic message from the message 
adapter 51 OA and can fonward a registerTopic message to the message topic server 
525. Upon receiving the registerTopic message, the message topic server 525 can 
register the message topic as in the case of nominal operations as discussed above 
and illustrated in Figure 2. 

Concurrently, upon receiving notification that the subscription to the message 
topic published through the message router 51 5A has been terminated, the message 
adapter 51 OB can attempt to re-subscribe to the message topic by transmitting a 
subscribeTopic message to the message router 51 5B. Upon receiving the 
subscribeTopic message, the message router 51 5B can forward a subscribeTopic 
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message to the message topic server 525. In response, as in the case of nominal 
operations, the message topic server 525 can reply to the received subscribeTopic 
message with a host identification of a message router suitable for providing a 
subscription to the requested message topic. As shown in the example of Figure 5, the 
host identification can identify the message router 51 5A. In consequence, the message 
router 51 5B can re-establish a communications link with the message router 51 5A 
through which data messages can be communicated from the message adapter 51 OA 
to the message adapter 51 OB. 

Figure 6 illustrates an exemplary recovery process triggered by the detection of a 
data publisher terminating a message topic. As shown in the figure, initially both the 
message adapter 61 OA and the message adapter 61 OC can register a message topic 
with the message topic server 625, However, subsequently, the message adapter 
61 OA, on behalf of a data publisher, can transmit to a corresponding message router 
61 5A an unregisterTopic message indicating an intention to discontinue publishing data 
messages consonant with the specified message topic. 

The message router 61 5A can, in turn, forward an unregisterTopic message to 
the message topic server thereby causing the message topic server to remove the 
message router 61 5A from the list of message routers able to provide a subscription to 
the message topic. Additionally, the message router 61 5A can notify the message 
router 61 5B that the message router 61 5A cannot continue to service a subscription to 
the message topic. In consequence, only the message router 615C remains able to 
service subscription requests for the message topic. 

Upon detecting the termination of the subscription service on the part of the 
message router 61 5A, the message router 61 5B can forward a terminateTopic 
message to the message adapter 6108. In response, the message adapter 61 OB can 
attempt to re-establish the subscription by transmitting to the message router 61 5B a 
subscribeTopic message. In turn, the message router 61 5B can fonA/ard a 
subscribeTopic message to the message topic server 625. Upon receiving the 
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subscribeTopic message, the message topic server 625 can query the list of message 
topics in order to Identify a message router able to service the subscription request. 
Although, in the example shown in Figure 6, the message router 61 5A has been 
removed from the list, the message topic server 625 can identify therein the message 
router 61 5C as a message router suitable for servicing the subscription request. As a 
result, in accordance with the message topic subscription process illustrated in Figure 
2, the message router 61 5B can transmit a subscription request to the message router 
61 5C. 

The recovery and re-synchronization processes illustrated in Figures 4-6 can be 
facilitated by the architecture of the distributed system of the present invention. An 
exemplary architecture suitable for use in the present invention is shown in Figure 7. 
Specifically, Figure 7 is a UIVIL diagram illustrating the structure of an application 705 
and corresponding message adapter 710 residing in a computing device 700. As 
shown in the figure, the application 705 can publish or consumer data in the form of 
content. The content itself can include adapter messages, router messages and server 
messages and can be encapsulated in a message payload 735. Moreover, the content 
can be accessed through exposed methods. 

The message adapter 710 can establish a communications link to a message 
router 715. As shown in the figure, the message router can establish and maintain 
communications links to multiple message routers. Additionally, the message router 
715 can create and process multiple router messages 730. Each router message 730 
can include content and transport data including a current address, destination address, 
and a source address. Additionally, each router message 730 can have an association 
with a message payload 735. As such, each router message can expose methods for 
accessing not only the current, destination and source address, but also the data 
contained in an associated message payload 735. 

Figure 8 is a state diagram depicting events received and processed in a 
message router and the state transitions flowing from those events. As will be apparent 

20 
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to one skilled in the art, the message router can respond to both messages from 
communicatively linked message adapters and other communicatively linked message 
routers. Significantly, the message adapter can detect error events, for example 
communication faults, and in response can initiate suitable recovery processes such as 
those illustrated in Figures 4-6. Specifically, as shown in the state diagram of Figure 9, 
the message router can perform error recovery first by determining whether the fault 
originated through in a message adapter or a message topic server. 

Thus, by virtue of the architecture of the present invention, the system and 
method of the present invention can re-synchronize interprocess communications 
between data publishers and data consumers in a distributed messaging system. 
Notably, the present invention can be realized in hardware, software, or a combination 
of hardware and software. Machine readable storage according to the present 
invention can be realized in a centralized fashion in one computer system, or in a 
distributed fashion where different elements are spread across several interconnected 
computer systems. Any kind of computer system or other apparatus adapted for 
carrying out the methods described herein is acceptable. 

A typical combination of hardware and software could be a general purpose 
computer system with a computer program that, when being loaded and executed, 
controls the computer system such that it carries out the methods described herein. 
The present invention can also be embedded in a computer program product which 
comprises all the features enabling the implementation of the methods described 
herein, and which when loaded in a computer system is able to carry out these 
methods. 

A computer program in the present context can mean any expression, in any 
language, code or notation, of a set of instructions intended to cause a system having 
an information processing capability to perfomn a particular function either directly or 
after either or both of the following: (a) conversion to another language, code or 
notation; and (b) reproduction in a different material form. The invention disclosed 
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herein can be a method embedded in a computer program which can be implemented 
by a programmer using commercially available development tools. 
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CLAIMS 

2 1 . A distributed messaging system for transmitting topical data messages from data 

3 publishers to data consumers comprising: 

4 a message topic server; 

5 a plurality of message routers; and, 

6 a plurality of message adapters; 

7 each data publisher communicatively linked to a message adapter, each data 

8 consumer communicatively linked to a message adapter, each message adapter 

9 communicatively linked to a message router and each message router communicatively 

10 linked to said message topic server; 

-1 1 p said message topic server having a list of message topics to which data 

12 f i consumers can subscribe and a list of data publishers able to publish data messages 

13 consonant with said message topics; 

14 C3 said message routers subscribing to selected message topics in said list in said 

15 m message topic server on behalf of requesting data consumers; 

16 L said message routers registering message topics with said message topic server 

17 3 on behalf of requesting data publishers which publish data messages consonant with 

18 j 3 said registered message topics; 

19 Si said message routers transmitting and receiving data messages to and from 

20 respective data consumers and data publishers according to said subscriptions; 

21 said transmitted and received data messages transmitted and received to and 

22 from said respective data consumers and data publishers through message adapters 

23 communicatively linked to said respective data consumers and data producers. 

1 2. A distributed messaging method for publishing topical data messages in a 

2 communications network comprising: 

3 receiving in a first message router from a data consumer a request to subscribe 

4 to a message topic; 
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5 responsive to receiving said subscription request, retrieving from a message 

6 topic server a location of a second message router communicatively linked to a data 

7 publisher able to provide data messages consonant with said requested message topic; 

8 establishing an interprocess communications connection between said first and 

9 second message routers; and, 

1 0 transmitting data messages from said data publisher over said established 

1 1 interprocess communications link to said data consumer. 

1 3. The method of claim 2, wherein said step of establishing an interprocess 

2 communications connection comprises establishing a multicast data communications 

3 [3 link between said first and second message routers. 

1 ' J 4. The method of claim 3, wherein said transmitting step comprises multicasting 

2 C3 data messages from said data publisher over said multicast data communications link 

3 rii to said data consumer. 

1 ^ 3 5. The method of claim 2, further comprising: 

2 11 detecting a communications interruption; 

3 E responsive to detecting said interruption, terminating said subscription, retrieving 

4 from said message topic server a location of a message router communicatively linked 

5 to a data publisher able to resume said providing of said data messages consonant with 

6 said requested message topic, establishing an interprocess communications connection 

7 between said first message router and said message router communicatively linked to a 

8 data publisher able to resume said providing of said data messages, and resuming said 

9 transmission of said data messages from said data publisher over said established 

10 Interprocess communications connection between said first message router and said 

1 1 message router communicatively linked to a data publisher able to resume said 

12 providing of said data messages. 

24 
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6. The method of claim 5, wherein said detecting step comprises: 

detecting a communications break between said data publisher and said second 

router. 

7. The method of claim 5, wherein said detecting step comprises: 
detecting a communications break between said first and second routers. 

8. The method of claim 5, wherein said detecting step comprises: 

detecting said data publisher terminating publication of said requested message 

topic. 

9. The method of claim 5, wherein said step of establishing an interprocess 
communications connection between said first message router and said message 
router communicatively linked to a data publisher able to resume said providing of said 
data messages comprises re-establishing an interprocess communications connection 
between said first and second message routers. 

10. A machine readable storage, having stored thereon a computer program for 
publishing topical data messages in a communications network, said computer program 
having a plurality of code sections executable by a machine for causing the machine to 
perform the steps of: 

receiving in a first message router from a data consumer a request to subscribe 
to a message topic; 

responsive to receiving said subscription request, retrieving from a message 
topic server a location of a second message router communicatively linked to a data 
publisher able to provide data messages consonant with said requested message topic; 

establishing an interprocess communications connection between said first and 
second message routers; and, 
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12 transmitting data messages from said data publisher over said establisiied 

13 interprocess communications link to said data consumer. 

1 11. The machine readable storage of claim 1 0, wherein said step of establishing an 

2 Interprocess communications connection comprises establishing a multicast data 

3 communications link between said first and second message routers. 

1 12. The machine readable storage of claim 1 1 , wherein said transmitting step 

2 comprises multicasting data messages from said data publisher over said multicast 

3 data communications link to said data consumer. 

1 J;f 1 3. The machine readable storage of claim 1 0, further comprising: 

2 "'^ detecting a communications Interruption; 

3 fa responsive to detecting said interruption, terminating said subscription, retrieving 

4 J'l from said message topic server a location of a message router communicatively linked 

5 ^ to a data publisher able to resume said providing of said data messages consonant with 

6 15 said requested message topic, establishing an Interprocess communications connection 

7 I : between said first message router and said message router communicatively linked to a 

8 S data publisher able to resume said providing of said data messages, and resuming said 

9 transmission of said data messages from said data publisher over said established 

10 interprocess communications connection between said first message router and said 

1 1 message router communicatively linked to a data publisher able to resume said 

12 providing of said data messages. 

1 14. The machine readable storage of claim 1 3, wherein said detecting step 

2 comprises: 

3 detecting a communications break between said data publisher and said second 

4 router. 
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5 1 5. The machine readable storage of claim 1 3, wherein said detecting step 

6 comprises: 

7 detecting a communications break between said first and second routers. 

1 16. The machine readable storage of claim 13, wherein said detecting step 

2 comprises: 

3 detecting said data publisher terminating publication of said requested message 

4 topic. 

1 1 7. The machine readable storage of claim 1 3, wherein said step of establishing an 

2 interprocess communications connection between said first message router and said 

3 ^ 3 message router communicatively linked to a data publisher able to resume said 

4 =^4 providing of said data messages comprises re-establishing an Interprocess 

5 ft communications connection between said first and second message routers. 
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ABSTRACT 

A distributed messaging method for publishing topical data messages in a 
cxjmmunicatlons network can include the steps of receiving In a first message router 
from a data consumer a request to subscribe to a message topic; responsive to 
receiving the subscription request, retrieving from a message topic server a location of 
a second message router communicatively linked to a data publisher able to provide 
data messages consonant with the requested message topic; establishing an 
interprocess communications connection between the first and second message 
routers; and, transmitting data messages from the data publisher over the established 
Interprocess communications link to the data consumer. 
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FROM : EXIGENT INTL 407 952 7555 2000,09-29 09=42 «412 

OOCKfr NUMBER £522:22 

POweft OP ATTORNEY: As a nsmed lovertof. I hereby appoint the following fiRomays end/or agents to 
prosecute this appficatlon bM transact all business in thd Patent and Trademark Office connected therawfth; 

J- Rodman Staaie, Jr. Reg. No. 26,931 

Gregory A, Nelson Re^. No, 30,577 

Joseph W. B8ln Reg. No. 34,200 

^ben J. Secco Reg, No. 35,367 

Stanley Kim Reg. No. 42,730 

Mark 0. Passler Reg. No, 40/764 

Steven Greenberg Reg, No, 44,725 

Send correspondence to Gregory A. Nelson, Quaries & Brady IIP, ZZ2 Ukeview Avenue^ Fourth Floor, P.O. Box 
318a, Wssi Palm Beach. Florida 33402-31 aa and Olrecpc e(i tefephone calls to Gfegory A, Nelson at {BSn 653- 
5000. 



FUa NAME OF INVgNTOR: Vtncent Kdvertl? 




INVENTOR'S SIGNATURg:-^g^<>^^'^ ^ DATE: ^ ^^^^^ 



e : ^y^^ 



-^5.- / 

RESIDENCE; 4497 Pinewood Road / 
Melbourne, PL 32934 ^ 

CITI2£NSHIP; U»S,A, 

POST OFFICE ADDRESS: 4497 Pinewood Road 

Melbourne, FL 32934 

FULL NAME OF INVENTOR: Eric Held 
INVENTOR^S SIGNATURE: 

RESIDENCE: jOgl N ., Mu^ . D , i ., H;ID HJI^ C\^U Af£ 

CITIZENSHIP: U.S.A. I^^*^ i^*ly> 3^90S' 

POST OFFICE ADDRESS: 8031 rapkleke"0rf»» 
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